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ABSTRACT 


Because application of conventional optimal linear regulator theory to 
flight controller design requires the capability of measuring and/or estimating 
the entire state vector, it is of interest to consider procedures for computing 
controls which are restricted to be linear feedback functions of a lower 
dimensional output vector aind which take into account the presence of measure- 
ment noise and process uncertainty. To this effect a stochastic linear model has 
been developed that awicounts for aircraft parameter vid initiaJ uncertainty, 
measurement noise, turbulence, pilot command and a restricted number of measurable 
outputs. Optimization with respect to the corresponding output feedback gains 
was then performed for both finite and infinite time performance indices without 
gradient computation by using Zangwill's modification of a procedure originally 
proposed by Powell. Results using a seventh order process showed the proposed 
procedures to be very effective. 
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1. Introduction 

Because application of conventional optimal linear regulator theory to 
fli^t controller design requires the capability of measuring and feeding 
back the entire state vector, it is of interest to consider procedures for 
computing controls which are restricted to be linear feedback functions of a 
lower dimensional output vector. Such a procedure, however, has Its limitations 
in that the feedback gains will be functions of the initial state vector. In 
addition, the presence of measurement noise and process uncertainty can lead 
to additional problems relating to both mocelling and computation. 

To this effect the stocheistlc linear model shown in fig. 1 was developed 

to take into account turbulence, pilot command, aircraft parameter and initial 

uncertainty, measurement noise, and a restricted number of measurable outputs. 

Both finite and infinite time performance indices were considered. Optimization 

with respect to the output feedback gains was performed ’using both gradient and 

non-gradient based algorithms. Taking into account both timing and stability 

considerations, the most favorable results were obtained using Zangwill's 

o 

modification of non-gradient procedure originally proposed by Powell . This 
procedure is such that if the cost index were indeed quadratic in the gains, 
then the search would be along a set of conjugate directions. 

The Zangwi 11 -Powell method is especially ’useful for infinite time perform- 
ance indices since many of the procedures proposed to date for finding output 

■j U 

feedback gains for such indices cannot be guaranteed to converge to a solution. ’ 
Additional problems also arise if an intermtdiate gain perturbation result in 
an unstable system. This ca.i be immediately corrected using the Zangwi 11 -Powell 
procedure by setting tae index itself to a ver: large number. 
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The effectiveness of the ZAngwill-Powell algorithm was evaluated using 
sixth order linearized longltudlnail eq’oatlons of motion for an aircraft. 

Results showed the algorithms to be capable of converging to a set of gains 
useful for gust alleviation. 

5 

Programs and the associatedusers guide are available from Mr. Ray Hood, 

NASA Langley Research Center. 

2. Problem Statement 

The system of Fig. 1 may be represented mathenatical-ly as follows: 

Process: x *A x + B u-K3 x + ^A x f u + w (l.a) 

P PP PPPn pp pp p ^ ' 

0 

Reference system: x ■ A x B w (l.b) 

r r r r r 

Disturbance s%stem: x^ = A x_ + B w (l*c) 

n n n n n 

where x^ = (NXP x 1) plant state 

x^ ■ (NXR X 1) reference state 

x^ a (NXN X 1) external disturbance state 

u = (NUP X 1) control vector 

w * (NXP X 1) zero mean white plant disturbance with covariance W 
P P 

w a (NWR X l) zero mean white reference excitation noise with 
r 

covariance W 

r 

w^ a (NXN X 1) zero mean vrtiite disturbance excitation noise with 


covariance W 

n 


A A. , a uncertainty in A^, B respectively. 

P P P P 


Outputs : 


y=C x+C x-fl 
P PP P pn n 

(2. a) 

y a C X 

•'r rr r 

(2.b) 

y a C X 
•'n nn n 

(2.c) 


1 


I 


I 


I 


r 


where » (NYP x 1) plant output 

■ (NYP X 1) reference output 

» (NYN X 1) disturbance output 

« (NYP X l) zero mean white sensor noise vector 




/ 


3. 


Control ; 


u » K y 

p yp P 


K y + K y 
yr "“^r yn •'^n 


where any of the elements iu the gains 




Index 


K con be fixed at a given value, 
yn 

T 




4(yp - y,) * “p’’ “p 


dt 


( 3 ) 




In order that this problem be cast into a more succinct form, the following 
definitions ore useful: 
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K - (K K K ) 

•'n 


PP 

0 


0 \ 

pn 




rr 
0 C 


nn 




This results in the following augmented system: 

Process: x*Ax-*-Bu-t- ^Ax + ^Bu + v(t) 

Measurement: y * Cx + n(t) 

Control: u ■ Ky 


1 ^ ^ T T 

Performance index: J®*t— V I (yQiy+u R u ) dt 

j J. P P 

* A 


( 5 ) 

( 6 ) 

( 7 ) 


Initial State - _ 

Covariance: ^ (x^ x^^) = P^ 


were: x » (n x 1) state vector 

u = ( X 1) control vector 
y « (m X 1) output vector 

K = gain matrix containing both fixed elements 

(most likely zero) and variable elements to be 
determined. 

V, n = white noise vectors with respective covariance 
matrices V, N. 

and ^ A, AB = uncertainty in A and B respectively. 

Two procedures were considered in order to take into account the total 
process uncertainty A Ax + ^Bu; namely: 

1) Defining 


w(t) = ZAx(t) r ^ 3u(t) 


( 8 ) 
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as an additionaJ. white noise vector with zero mean and assigned covariance 
matrix W suitably chosen to reflect the uncertainty. The procedures 
developed by Joshi^ are then applicable to solution. 

2) Letting AAx = ^ ^ a^ 


and 


ABu 


Z “i 


(9a) 

(9b) 


where ^a^^, the i columns ot A k and AB respectively, are in turn set 

equal to 

Aai « w 
Abi = Gi w 

where w is a white noise vector with covariance matrix W, and F^, are constant 

7 

matrices. The optimization procedure cited by McLane are then applicable to the 
solution. 

Substituting eqs. 5 and 6 into J, eq. 7 gives 


tj. 

J = £ ~ J ^x"^ Cx + 2x"^ Q^n 


( 10 ) 


rp ^ w ^ ^ ^ ^ w ^ I 

+ n Q^n + X C K R K C X + 2 X C K R n n R K n dt 

This formulation of the index can be simplified by noting that 
£ Qj_n) = £ (x^ R n) =0 

^ T 

Furthermore ^ (n Q^n) is a constant term independent of the control and 
therefore has no affect on the index. Thus minimization of (10) is equivalent 
to the minimization of 

o = £ ^ y* x'“^(C^ k'^ R K C) X dt + £ (n^ k’’ R K n) 


( 11 ) 
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Sliininatlon of the expectation operator Is now possible by recognizing 
that J can be rewritten as: 

J - Trace (C*^ C R K C) S + Trace (k'^ R K N) (12) 


where 



( 13 ) 


Thus upon computation of the integral of the state covariance matrix £^(x x'^) , 
the value of the Index can be found from eq. 12. 

In particular if t^ is finite, the covariance 

P - 6 (x x^) (lU) 


caji be readily propagated, given a value for K, as follows: 
. Formulation defined by eq. 8^. 



P » (A + B K C) P + P(A + B K C)'^ + B K N b'^ t- (V f W) 

(15a) 


P(0) » £ (x(0) x^(0)) 

7 

. Formulation defined by eq. 9 • 

P « (A + B K C) P + P(A + B K C)^ + M(P, K) + N(K) 

(15t) 


+ B K N k’^ B^ + V 

(l6a) 


P(0) » f (x(0) xT(0)) 

(l6b) 

where 

M(P, K) =2, PiJ ^ W V 
ij 

(I6c) 


N(K) = ^ G^(K^ N Kj^) W 

iJ 

A 

(l6d) 


1 1 

th * 

» i^'^ row of K 

(I6e) 

and 

Pj^j = i - component of P 
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For the case in which t^ ■ od , the integral S of eq. 13 will not in 
generail converge if. there is measurement noise (n) €md/or process noise (v) . 
Thus in this case (as in refs. 3» 6) in t’* limit S will be replaced by 


S ■> Lim 

tj .— >00 




(17) 


where P is the steady state solution to either eq. 15 or eq. l6. 
ss 

It is of importance to note at this point that McLane in ref. 7 cites a 

potential, convergence problem with the steady state solution to eq. l6 if the 

noise intensity is too high. This results from the need for very large feedback 

ffains. In fawt during the numerical experiments, divergence occurred in the 

presence of multiplicative noise stauidard deviations equal to l/lOO of the 

8 

corresponding entries. Consequently the infinite time version of the 
formulation defined by eq. 9 wa;» not developed beyond the experimental stages. 


3. Computational Procedures 

Since the performamce index (eq. 12) is easily evaluated given a value for 

1 2 

the gain matrix K, the Zangwill-Powell ' method which does not require gradient 

computation was very attractive for optimization. This algorithm has been coded 

g 

into IMSL sub-routine ZXPOWL. Initial values for elements of the gain matrix K 
are given to this program vrtiich then -'akes successive perturbations in each of 
the variable elements and computes the corresponding val'ue of J. Using the 
computed Indices, perturbation directions are chosen such that if the index 
were q’uadratic in the gains, the search would be along a set of conjugate 
directions. One particular attractive feature of this algorithm is the ability 
to correct, when t^ « oo , for a set of 'uistable gains which do not permit the 
determination of a steady state ccvariance matrix, P. This was done by computing 
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the eigenvmlues of (A B K C) for each perturbed value of K and setting J 
equal to a very large number (l.e., 10^®) whenever instability was noted. 

For comparison purposes, grauiient based procedures were also considered. 

Procedures searching along the directions of steepest descents "nd conjugate 

gradients were evaluated for the finite time index < oo ) and were observed 

to be no faster than the Zangwill-Powell method. For the infinite time Index, 

optimization was performed using a modification of the gradient method applied 

11 12 

by Horlsberger and Belanger to deterministic systems. ' This led to 
unstable intermediate gain selections that resulted in divergence of the search 
procedure. Such Instabilities are not w -easonable to expect since the 
computed gradient represents the rate of change with respect to K of the index 
defined by eq. 12 and the steady state solution of 15 or l6. If however the 
resulting perturbation along the computed gradient results in destabilizing 
gain K, then the index evaluated with eqs. 12 and 15 or l6 will be erroneously 
finite rather than Infinite. In fact the steady state solution to 15 or l6 
with a destab ilizint, gain could be negative definite resulting in a negative 
rather than infinite valued index. To more precis ,ly illustrate this behavior, 
note that the gradient of the index J with respect to tie gain K is equal to:^'^ 


It * h 


T T T 

3 L P C + 3 L3KN 
s 


where 


(18) 


0 » (A -t- BKC)'^ L + L(A + BKC) f (ft + RKC) (19) 

However these equations are valid only if the gain stabilizes the closed loop 
system (A BKC) . If as a result of a perturbation, the gain K is not stabilizing, 
then Eq. 19 for L is no longer valid. In fact the gradient defined by Eq. l8 is 
in reality the gradient of Trace (L) with respect to K since J = Trace (L) if 
K is stabilizing. It is possible to have a value of K which in reality would 
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result in an unstable system (i.e., J *00 ) but when used in Eq. I 9 gives a value 

of L < 0 which in turn causes J to be negative. 

To correct this behavior, the sequential unconstrained minimiraticn technique 

of Fiacco and McCormick^^ was used to optimize the index with respect to K subject 

12 

to the constraints that all closed loop eigenvalues be negative. ThJr procedure 
converged properly but required 5-10 times larger than the Zargwl 11 -Powell method. 

Thus the non-gradient based Zangwill-Powell method was recotnnended as the 
procedure for solving the stochastic reduced state feedback gain optimization 
problem. Specific details of the available programs are contained in the Ibers' 
Qulde^ available from Mr. Ray Hood, NASA Langley Research Center. 




U. Experimental Resales 
U.l System definition 

A modified 6 -dimensional version of the TIFS"^** aircraft with a gust 
input ( ^ » 15 fpa) was used for evaluation in the presence of a zero reference 
command. The corresponding variable definitions were as follows: 


Plant state: 


/* 


\ 


q 

A V 

ot 

<5e 

6 z 


& 


( pitch rate 
pitch angle 
velocity 
angle of attack 
elevator deflection 
direct lift flap deflection 
gust induced attack angle 



Plant control: 

u 



elevator command \ 
lift flap command j 
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Observations : 


Z - 


/ 


pitch rats \ 

/A 9 


pitch angle 

a 

m 

angle of attack 

nzi 


Point 1 vertical acceleration 

1 ""2 


Point 2 vertical acceleration 

\ i 


flight path angulau: rate 


The structural oatrlces corresponding to climb condition, i.e., h * 152 h m, 
V ■ 106 m/s, which were used for design purposes are: 



B 


P 


686 

.000035 

.000231 

1. 

0. 

0. 

0. 

-’2.17 

-.0143 

1 

.U.UCOOI3 

-.000531 

0. 

0. 

0. 

0. 

0. 

0. 



-.U86 -4.3778 -.19948 

0 . 0 . 0 . 

18.027 0. -3.0933 

-1.223 -.1273 -.2667 

0 . - 20 . 0 . 

0. 0. -40. 



~ (-.2784) 


* (.01815) 
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f 

0. 

0. 

0. 

0. 

0. 

0. 

1. 

0. 

0. 

o._ 

0. 

0 

0 

0 

1 

0 

0 

64.63 

.00318 

.176 

444.2 

212.1 

100.4 

-61.82 

.00580 

.193 

407.8 

- 116.2 

85.5 

0. 

.000013 

.000531 

1.223 

.1273 

.2667 


Cprj - (0, 0., 0., UUU.2, U07.8, 1.223) 


C - 0 
rr 


C -0 

mi 


Corresponding sensor noise deviations considered were; 

<3*^ ■ .5 deg/sec 

OTq = 0.2 deg 

8 

z 

Given these constraints, feedback gains for q., A 9, A a were determined so as 
to minimize 

J = £ <i22(Ae)® * * i55'"22> 




Values for and r^^^^ were chosen to be representative of the inverse maximum 
squared value of the weighted variables. In pai’ticular the following values were 
used: 

. 2500 . 

122 = 50 . 

qjj . 50. 


U . or 0 . 


4. or 0. 
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« 2500 . or 0. 



The coveurlance of the plant disturbance was chosen to be either 
Wpi » Dlag (.2, 0., . 0007 , .0005» 0., 0.) 


or W « ■ 0 

P*- 

These eleaents were chosen by computing for each component of the state equation 

Wp(l, 1)^^ 

J 


where A was approximated to reflect the data in reference l4. 

Considered also was the case in which process uncertainty was represented 
by eq. 9 with 


(Fi, F, 




"3' 

^4' 

^5' ^6^ 

” 



4 

0 

.002 

.2 

2.2 

.ll\ 

0 

0 

0 

0 

0 

0 ’ 

0 

0 

.001 

.17 

0 

.025 

0 

0 

0 

.24 

.024 

.16 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 / 


and ® 0 . 


4.2 Computational results 

Using the preceding data, the six gains relating q, As, Ao: to ^e^ 

and Sz were determined, 
c 

Of Interest were the following obsen/ations relative to the general 


computational procedures; 
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. Convergence time on the CDC 6600 vras Uo sec for the Infinite 
time problem and 8l sec for a two second Index. This difference 
resulted from having to compute only the soluclon to a set of 
algebraic equations rather than a set of differential equations 
over a two second Interval. 

. Assuming that every 6 gain perturbations called for by the 
Zangwl 11 -Powell method corresponds to a gradient evaluation, 

It was noted that the number of gradient -(valuations performed 
by a steepest descent algorithm wss comparable to the number 
performed by the Zangwlll-Powell method. 

. For a finite time Index It Is Indeed possible to obtain gains 
that yield an unstable set of eigenvalues. 

. For meaningful parameter uncertainties, optimizaticn of the 
Infinite time Index subject to the steady state solution of 
eq. l6, led to divergence. 

U.3 Simulation results 

In order to illustrate the effects of the various weights and noise 
terms, results are presented for the following cases: 


Case 

Covariance eq. 

%k> ^33' ^6 

W 

P 

*f ' 

1 

15 

o 

o 

o 

W I 

pi 

2 

C. 

15 

U, 4, 2500 

pi 

2 

3 

15 

o 

o 

o 

W . = 0 
pO 

2 

U 

15 

o 

o 

o 

w I 
pi 

00 

5 

15 

4, 4, 2500 

W T 

pi 

00 

6 

l6 

o 

o 

o 


2 

7 

16 

4, 4, 2500 


2 
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Cases 1-3 correspond to a finite time 'ndex with the uncertainties 

represented as additive white noise. Variations on this uncertainty and on the 

# 

n and ^ weighting, are incorporated. Cases U, 5 are infinite time versions 
z 

of cases 1, 2 respectively. Finally, cases 6, 7 correspond to the finite time 
optimization problem in which the parameter uncertainty is represented as 
multiplicative noise. Recall that the infinite time version of this latter case 

g 

would not converge except for neau: negligible parameter variations. 

Resulting gains and the corresponding closed loop eigenvalues for 

these cases and the open loop system ar* contained in Table 1. Of interest are 

the following observations: 

. Use of a finite time index can lead to a set of 

destabilizing gains. This occurred in cases 1 

and 3 which did not incorporate penalties on 

n and ^ . 
z 

. Use of an infinite time index (case U, 5) resulted 
in a stable closed loop system. 

In order to evaluate the effectiveness of the gains given In Table 1, 
the following 3-second simulations were made: 

. Gust input, measurement noise, initial states * 0 
. Gust input, measurement noise, initial states * 0, but at 
the cruse flight condition (h = 3048m, v » IU9.66 m/s). 

. No gust, no measurement noise, q(0) = .02 r/s, 

Ae(0) - .15 r, Aa(0) = .15 r. 

. No gust, no measurement noise, q.(0) = .02 r/s, A 9(0) = .15 r, 
Aa(0) « .15 r, but at the cruise fli^t condition 


(h = 3048 m, V « 149.66 m/s). 
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The first twc simulations were used to evaluate the effectiveness 
of gust alleviation at both the designed flight condition euid at a perturbed 
flight condition. The second two Jimulatlons tested the resulting transient 
performance. 

Tables II and III give the rms errors over the three second interval 
for each of the states. In Interpreting the results, it should be noted that 
whereas the length of the optimization interval was either infinite on 
two •ec'^nds, the eval'uation interval was three seconds. Of interest are the 
following observations : 

. Best gi'st alleviation with • espect to open loop performance 
results when an infinite time index is used. 

. Small improvement in ternu' of cms er.*ors results from 

weighting n and 
z 

. Behavior for the 2nd flight condition is comparable with 
the first. 

Typical transiet responses for a suid ^ are given In Figs. 2-8 for 
the open loop system and cases 1, 2, U, 5, 6, 7 respectively. The following 
obseirvaticns were noted: 

. Incorporation of a weighting term on significantly 
reduces its settling time, but possibly at the expense 
of a degradation in the a response (as in cases 2, 5). 

. Representation of the pareuneter uncertainty as multiplicative 
noise led to slower responses. 

. The influence of the wei^ting matrix Q is more pronounced 
for transient behavior than for rms gust response errors. 
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3. Conclusions and Recommendation 
5.1 Conclusions 

Optimal output feedback control gains were determined using the 
Zangwill -Powell procedure which does not require gradient computation. Two 
stochSLStic formulations of the process equation were considered in order to taike 
into account process uncertainty, process disturbances and sensor noise. Results 
using a seventh order system showed that the Zangwell-Powell method is very 
effective for control gain computation. 

Significant among the conclusions resulting from this study are the 

following : 

. Use of a finite time performance index can result in a set 
of gains which do not stabilize the closed loop system. 

. If it is possible at all to stabilize the system with the 
specified feedback configuration, then the optimization of 
an infinite time performance index will yield a set of gains 
that do indeed stabilize the closed loop system. 

. Optimization of infinite time indices is less time consuming 
than the optimization of finite time indices because of the 
need to solve algebraic and not differential equations. 

. Gradient based algorithms when applied to the optimization 
of infinite time indices can result in divergence. This in 
particular results when the gradient is computed using the 
algebraic steady state Riccati solutions to the matrix 
covariance and co-state equations. 
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. Pe^’fonnance Is very sensitive to the selection of the 
penalty matrices Q and R. 

. Reduced state feedback concrol can be effective for guet 
alleviation. 

. An initial gain matrix that stabllzes the system Is needed 
for the infinite time cases. 

5.2 Reccmme*?ac;tlons 

In view of the fact that the prime objective of this study was to 
develop a set of programs useful for reduced state feedback control compxitation, 
it is recommended that future efforts be concerned with procedures for applying 
these proced:j:es towards design of flight control systems. Specifically further 
studies should be made to determine techniques for applying reduced state stochastic 
infinite time optimization procedures to the design of control systems for flexible 
aircraft. This would then involve the following activities. 

. Develop procedures that determine initial gains for stabilizing 
the closed loop system. Since optimization of infinite time 
indices requires an initial stabilizing gain matrix, which is 
not always readily available, it would be deslreable to in- 
clude an initializing procedure that determines a set of 
stabilizing gains if possible with the assigned feedback 
structure. If this is not possible, then the program should 
request a modification to the structure. 

. Evaluate the effectiveness of procedures for incorporating 
aircraft parameter uncertainty. At present either additive or 
multiplicative noise has b .n used for representing aircraft 
parameter uncertainty. A study needs to be made of how the 
corresponding noise covariances should be chosen so that control 
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gaina designed for one flight condition may be used at other 
flight conditions. An additional Item of Interest would be 
the representation of the parameters as constant but unknown 
ramdom qutmtltles, rather than the time veurying quantities 
presently being used. 

. Study the sensitivity of the designs to Initial conditions. 

. Consider tne deslgji of controllers for (l) gust alleviation 
(2) Initial condition response, and (j) pilot command follow- 
ing. Evaluate how a controller designed for one of these three 
conditions will perform under the other two situations. 

. Consider the Inclusion of gain magnitude constraints. 

6. Publications and Presentations 
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"Applications of the Zimgwlll-I'cwell Method In Computing Output 
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"Cco^jutatlon of Output Feedback Gains for Linear Stochastic 
Systems Using the Zangwlll- Powell Method" by H. Kauftoan, sub- 
mitted to IEEE 1976 Conference on Decision and Control, 
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Master Project Reports 

"Reduced State Feedback Gain Computation for a Linear Stochastic 
Infinite Time System Using the Zangwlll-Powell Method" by 
Paul Bay, R.P.I., Dept, of Electrical and Systems Eng., May 1976. 

"Computation of Constant Optimal Output Feedback Gains for 
Linear Systems," by David A. Peterson, R.P.I., Dept of 
Electrical and Systems Eng., Ms^ 1976. 
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TABLE II 

RMS ERRORS FOR THE CLIMB FLIOUT CONDITION US DIG 
GAINS DESIGNED FOR THIS CONDITION 



q 


A a 

^”31 

''”32 

# 


(r/ 5 ) 

(r) 

• (r) 



(r/s) 

Open 

Loop 

.00976 

.00366 

.0131 

8.24 

7.66 

.0235 

1 

.00966 

.OOJ +12 

.00967 

9.22 

7.27 

.0218 

2 

.0118 

.CO826 

.0185 

8.96 

8.13 

.0258 

3 

.00920 

.00350 

.0101 

7.23 

6.67 

.0203 

k 

.00959 

.COU09 

.00889 

9.15 

6.07 

.0212 

5 

.0112 

.00713 

.0165 

8.69 

7.92 

.0249 

6 

.00932 

.00350 

.0122 

7.86 

7 . 3 ^* 

.0235 

7 

.00927 

.00414 

.0123 

7.71 

7.24 

.0222 


TABLE III 


RMS 


ERROR FOR THE CRUISE 
OAINS DESIGNED FOR 


^IGHT CONDITION USING 

the climb condition 


q 

( r / a ) 

.OO93U 

^ e 

(r) 

.0031*7 

.00977 

.001*17 

.0183 

.0208 

.0083 

.001*05 

.00978 

.001*00 

. 011 $ 

.0103 

.00889 

.00372 

.0889 

.00509 


A a 

^ n 

(r) 


.0118 

7.80 

.00900 

9.22 

.0241 

8.81 

.00078 

6.78 

.00806 

9.17 

.0164 

8.48 

.0107 

7.47 

,0109 

7.30 


^ n 

32 



(r/a 

7.24 

.0226 

7.02 

.0215 

7.87 

.0253 

6.26 

.0196 

6.70 

.0210 

7.61 

.0243 

6.97 

.0218 

6.88 

.0218 
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